feat(HEBO): Added initial support for single/mutli objective HEBO #166
Conversation
eddiebergman
force-pushed
the
feat-hebo
branch
from
2fa5f79 to
5375b32
Compare
| @overload | ||
| @classmethod | ||
| def worst_possible_cost(cls, metric: Sequence[Metric]) -> list[float]: | ||
| ... |
There was a problem hiding this comment.
May I ask if the "..." operator allows execution to simply fall through to the method defined below?
There was a problem hiding this comment.
The ... is essentially just a value, just like writing the number 4. For example,
These are both perfectly valid python code:
def f(x: int):
4def f(x: int):
z = ...What's making it fall through is the @overload. You can basically think of them as just doc strings that type checkers and language servers can use for better "intellisense". In the example you pointed out, if you pass in a Sequence[Metric], you can expect worst_possible_cost to give you back a list[float]. If you pass in a Metric, you'll get back a float.
Without them, your editor/language server will say, x = worst_possible_cost(single_metric) is either a float or list[float], even though you know it's a float.
There was a problem hiding this comment.
Thank you for the clarification.
NOTE: I will likely merge this soon given I have not heard back from HEBO developers.
DRAFT
This PR implements what I could gather from the HEBO documentation.
So far it seems I could get single objective optimization in and also multi-objective.
There's a few possible issues marked with
#TODO, such as HEBO not supporting an unbounded optimal (even if only theoretical) due to it's observe removing non-finite entries. Also tests still need to be added for HEBO space parsing, however it seems to at least function with a basic{"x": (1.0, 10.0)}space.Some other points:
ref_pointinGeneralBO, it seems I can leave it asNoneand that would seem safer than specifying my own. However if I have the information, it might makeGeneralBOmore effective to provide it. Not sure how it acts withinfboundaries as the reference point though.